Capacity of oscillatory associative-memory networks with error-free retrieval.

نویسندگان

  • Takashi Nishikawa
  • Ying-Cheng Lai
  • Frank C Hoppensteadt
چکیده

Networks of coupled periodic oscillators (similar to the Kuramoto model) have been proposed as models of associative memory. However, error-free retrieval states of such oscillatory networks are typically unstable, resulting in a near zero capacity. This puts the networks at disadvantage as compared with the classical Hopfield network. Here we propose a simple remedy for this undesirable property and show rigorously that the error-free capacity of our oscillatory, associative-memory networks can be made as high as that of the Hopfield network. They can thus not only provide insights into the origin of biological memory, but can also be potentially useful for applications in information science and engineering.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Enhanced storage capacity with errors in scale-free Hopfield neural networks: An analytical study

The Hopfield model is a pioneering neural network model with associative memory retrieval. The analytical solution of the model in mean field limit revealed that memories can be retrieved without any error up to a finite storage capacity of O(N), where N is the system size. Beyond the threshold, they are completely lost. Since the introduction of the Hopfield model, the theory of neural network...

متن کامل

Iterative retrieval of sparsely coded associative memory patterns

We investigate the pattern completion performance of neural auto-associative memories composed of binary threshold neurons for sparsely coded binary memory patterns. Focussing on iterative retrieval, eeective threshold control strategies are introduced. These are investigated by means of computer simulation experiments and analytical treatment. To evaluate the systems performance we consider th...

متن کامل

Phase Memory in Oscillatory Networks

As it was shown earlier, oscillatory networks consisting of limit-cycle oscillators interacting via complex-valued c onnec-tions can be u s e d for associative memory design. Phase memory as a special type of associative memory in oscillatory networks has been invented and studied. Detailed analysis of phase memory features of phasor networks related to oscilla-tory networks has been performed....

متن کامل

Fast Weight Long Short-term Memory

Associative memory using fast weights is a short-term memory mechanism that substantially improves the memory capacity and time scale of recurrent neural networks (RNNs). As recent studies introduced fast weights only to regular RNNs, it is unknown whether fast weight memory is beneficial to gated RNNs. In this work, we report a significant synergy between long short-term memory (LSTM) networks...

متن کامل

Recurrent Associative Memory Network of Nonlinear Coupled Oscillators

The recurrent associative memory networks with complexvalued Hebbian matrices of connections are designed from interacting limitcycle oscillators. These oscillatory networks have peculiarities and advantages as compared to Hop eld neural network model. In particular, the class of networks with high memory characteristics (the capacity close to 1, low extraneous memory) exists. At zero values of...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Physical review letters

دوره 92 10  شماره 

صفحات  -

تاریخ انتشار 2004